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TITLE 

METHOD, APPARATUS AND COMPUTER PRODUCT PROGRAM FOR 
PERFORMING SHADING CORRECTION OF IMAGE PROCESSING 

APPARATUS 

BACKGROUND 

Field 

This patent specification relates to a method, an apparatus and a 
computer program product for performing a shading con-ection of an image 
processing apparatus, and more particularly adjusting shading correction data for 
an abnormal pixel using a predetermined value to perform an appropriate shading 
correction. 

Discussion of the Background 

Generally, an image reading apparatus includes an image sensor, such as 
a CCD and an analog/digital converter to convert optical infomiatlon obtained by 
optically scanning an original document into an electric signal using the image 
sensor. The electric signal is then converted into multivalued image data by the 
analog/digital converter. 

In such an image reading apparatus, the conversion process to the image 
data is controlled according to a contrast of an original document and a luminance 
change in a light source. Because an output from the image sensor is especially 
Important, a shading correction is performed to con-ect a sensitivity of the image 
sensor. 
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A white plate is used for a shading correction. A standard value for the 
shading correction is set based on a reading result of the white plate. 

Therefore, if the white plate is dirty, a correct standard value may not be 
obtained. Thus, an improper shading correction may be performed resulting in 
outputting degraded image data. Further, if fouling adheres to a platen which 
contacts a reading surface of an original document or to a component in a light 
path, such as a lens, or when the image sensor is defective, degraded image data 
can be output, which is different from the output when the white plate is dirty 
because not only standard shading correction data but also read image data are 
affected. Such a degradation of image data caused by the above-described 
fouling cannot be removed by a shading correction. 

Japanese Patent Laid-Open Publication No. 11-122490 discusses a 
technology for handling degradation caused by dirt or fouling to improve a reading 
perfomnance of an image reading apparatus. 

According to Japanese Patent Laid-Open Publication No. 11-122490, the 
image reading apparatus, in which a shading correction on image data of an 
original document is performed using shading correction data obtained by reading 
the white plate, includes an abnomial pixel detection section which detects an 
abnonnal pixel in the image data obtained by reading the white plate. The 
apparatus also includes a diagnose section to determine whether or not the 
abnormal pixel detected by the abnomnal pixel detection section is caused by dirt 
on the white plate. 

The apparatus further includes an abnomial pixel correction section to 
correct shading correction data obtained at a position where an abnormal pixel is 
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detected when the detected abnormal pixel is caused by dirt of the white plate. 
The abnormal pixel correction section corrects the shading correction data by 
using data of a pixel around the abnormal pixel when the detected abnormal pixel 

is caused by factors other than dirt on the white plate. 

A memory device is required to store information about a position of an 
abnormal pixel to identify the abnormal pixel in the shading correction data in the 
image reading apparatus discussed in Japanese Patent Laid-Open Publication No. 
11-122490. Standard shading data or image data must be corrected based on 
information on the position of the abnormal pixel. 

For example, a special memory device may be employed to store a result 

Of the determination made by the abnormal pixel determination section so as to 

store information about the position of the abnormal pixel. 

However, an abnormal pixel may be very rarely detected when the 
apparatus is used in a normal condition, and entropy may be very small from an 
information engineering standpoint. Nevertheless, it increases in costs to provide 
a special memory device to store image information for such corrections in order to 
form a high-quality image. 

SUMMARY 

The disclosure herein takes into account and addresses the above- 
discussed and other problems, and describes a novel image reading apparatus 
that can provide a high-quality image at a reduced cost. 

According to an example of a preferred embodiment, an image reading 
apparatus includes an image sensor configured to read an image of an original 
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document, a shading correction device configured to perform a shading correction 
on read image data, and an abnormal white image pixel detection device 
configured to examine a value of standard white image data on a pixel-by-pixel 
basis to determine whether or not a pixel is abnormal, wherein the standard white 
image data is acquired by reading a white image which is a standard for a shading 
correction. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete appreciation of the disclosure and many of the attendant 
advantages thereof will be readily obtained as the same becomes better 
understood by reference to the following detailed description when considered in 
connection with the accompanying drawings, wherein: 

Fig. 1 is a schematic drawing illustrating a construction of an original 
document feeding system and an optical system of an image reading apparatus 
according to an example of a preferred embodiment; 

Fig. 2 is a block diagram illustrating a processing system of image data of 
the image reading apparatus; 

Fig. 3 is a flowchart illustrating a reading operation of 
an image of an original document in the image reading apparatus; 

Fig. 4 is a diagram illustrating an example of standard shading data before 
a correction is performed; 

Fig. 5 is a diagram illustrating an example of standard shading data after a 
correction is performed; 

Fig. 6 is a diagram illustrating an example of standard shading data after 
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two levels of correction are performed; 

Fig. 7 is a diagram illustrating an example of a digital image signal IDc 
output by a shading correction section SC in an original document reading mode; 

Fig. 8 is a diagram illustrating an example of a digital Image signal IDd; 

Fig. 9 is a diagram illustrating another example of the digital image signal 
IDc output by the shading correction section SC In the original document reading 
mode; 

Fig. 10 is a diagram illustrating another example of the digital image signal 

IDd; 

Fig. 1 1 is a flowchart Illustrating an example of process performed by an 
abnormal pixel correction section BD in an abnormal pixel detection mode; and 

Fig. 12 is a flowchart Illustrating an example of process performed by the 
abnormal pixel correction section BD in an uncorrectable pixel column detection 
mode. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 
Referring now to the drawings, wherein like reference numerals designate 
identical or corresponding parts throughout the several views, Fig. 1 is a schematic 
drawing illustrating a construction of an original document feeding system and an 
optical system of an image reading apparatus according to an example of a 
preferred embodiment. 

An original document DK is fed toward a reading position while being 
sandwiched by a pair of sheet feeding rollers R1 and R2. The original document 
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DK is then conveyed between a platen CG and a white plate WT to a pair of sheet 
discharging rollers R3 and R4 which are arranged at the opposite side of the 
apparatus. Then, the original document DK is discharged by the pair of the 
discharging rollers R3 and R4. 

The original document DK Is irradiated with a beam of light emitted from a 
laser light source LT. The light reflected from the original document DK is led to a 
lens LZ to form an image on a line image sensor SS. 

Fouling G1 adheres to a surface of the white plate WT. The fouling G1 

does not affect a read image because the fouling G1 is hidden by the original 
document when an image of the original document DK is read. 

However, as described below, the fouling G1 affects the reading of the 
white plate WT to form a standard white image to be used in a shading correction 
operation. 

Fouling G2 on platen CG affects a read image both when the original 
document DK is read and when the standard white image for the shading 
correction is formed, because the fouling G2 is in a light path from the linear light 
source LT, through a reading position of the original document DK, the lens LZ, to 
the line image sensor SS. 

Thus, there are two types of fouling which adhere to an optical system. A 
first type of fouling causes abnormal pixels (pixel values) when forming a standard 
white image for a shading correction but does not cause abnormal pixels when 
reading the original document DK. A second type of fouling causes abnormal 
pixels both when forming the standard white image for the shading correction and 
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when reading the original documents DK. 

Fig. 2 is a block diagram illustrating a processing system of image data of 
an image reading apparatus according to an example of a prefen-ed embodiment. 

Before describing the system of Fig. 2 in detail, a qualitative description is 
given of the examples illustrated in Figs. 4-10. Fig. 4 illustrates results of scanning 
a white plate with fouling at locations LA and LB that reduce light reflection and 
decrease the measured white image pixel values. This fouling can be the G1 type 
shown in Fig. 1 (behind the document DK), or type G2 (between the light source 

and the document), or both. Fig. 5 illustrates one way of correcting the white 

image data at the abnormal portions caused by the fouling - set the abnormal pixel 
values to a maximum such as FFh (alternatively, to a minimum such as OOh, not 
illustrated). Fig. 5 illustrates another way of correcting the white image data at the 
abnormal region LB, useful when region LB is too large in size (exceeds a certain 
number of pixels) - set the values of the pixels in region LB to some value lower 
than normal white data, such as 0.9 times nearby normal pixel values or some 
other measure of normal values. 

Fig. 7 illustrates shading-corrected documents image data that has been 
subjected to a shading correction based on white image data con-ected as in Fig. 6 
in which the document image data was derived when fouling such as G1 was 
present but not fouling such as G2. Fig. 8 illustrates the document image data of 
Fig. 7 that has been further corrected by replacing the pixel values in region LA 
with the value of a normal pixel (or pixels) nearby, for example one or more pixel 
values derived just before the values of region LA are derived. Fig. 9 Illustrates 
document image data derived when fouling such as G2 is present at two locations, 
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producing decreased signal at regions LA and LB. Last, Fig. 10 illustrates the 
document image data of Fig. 9 after correction in which the pixel values in region 
LA were replaced with nearby normal data and the pixel values in region LB (which 
exceeds a certain size) were replaced with shading-corrected document image 
data derived by using shading data such as in region LB in Fig. 6. 

Referring now to Fig. 2, an analog image signal lA is output from the line 

image sensor SS for each pixel along of a main scanning direction at every one 
line reading cycle. The analog image signal 1A is converted into a digital image 
signal ID of a predetermined number of bits per pixel (for example, 8 bits). The 
converted digital image signal ID is transmitted to a darkness level correction 
section BC. 

The darkness level correction section BC corrects for a value of a 
darkness level of the input digital image signal ID based on data which is stored in 
a memory BM. A corrected digital image signal IDb is then transmitted to a 
shading correction section SC. For example, the digital image signal ID, 
corresponding to a dark current which is obtained by activating the image sensor 
SS before the linear light source LT lights up, may be used as the data to be 
stored in the memory BM. 

The shading correction section SC stores the data of one line of the 
transmitted digital image signal IDb in a memory WM when obtaining standard 
white image data (hereinafter to be referred to as standard shading data). The 
shading correction section SC performs a shading correction on one line of the 
transmitted digital image signal IDb using the standard shading data stored in the 
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memory WM when reading the original document DK. A digital Image signal IDc of 
the original document DK. on which the shading correction has been performed, Is 
then transmitted to an abnormal pixel correction section BD. 

For example, the shading correction section SC performs a computation 
5 using a below-described expression (1). 

\/o(n) = Vi(n) x Vp / Vs(n) (I). 

Vo (n) is a shading correction result of pixel "n" of original document 
image data, and Vi (n) is the digital image signal IDb of same pixel "n" of original 
Sd document image data before the shading correction is performed. Vp is a peak 
value of shading correction data, and Vs(n) is shading correction data of the same 
pixel position "n" from memory WM. 

An abnormal pixel detection section BB detects an abnormal pixel in pixels 

H read by the line image sensor SS based on standard shading data which is stored 

n t 

p in the memory WM by the shading correction section SC. A value of the standard 
shading data is replaced with all white value (FFh) or all black value (OOh) for the 
pixel detected as abnomnal. 

When the number of successive abnormal pixels exceeds the number that 
can be corrected by the abnormal pixel correction section BD (i.e., allowable 
2 0 correction number),the standard shading data of the abnonnal pixels, which is 
stored in the memory WM, is replaced with a value obtained by multiplying a peak 
value of the standard shading data by a predetemiined value (for example, "0.9" ). 
When reading an image of the original document DK, abnormal pixels thereof are 
detected based on the standard shading data stored in the memory WM. The 
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detection of the abnormal pixels is reported to the shading correction section SC. 
The detection of the abnormal pixel is then reported to the abnonnal pixel 
correction section BD from the shading correction section SC. 

In reading an image of the original document DK, the abnonnal pixel 
correction section BD outputs the digital image signal IDc, which is transmitted by 
the shading correction section SO, to a peak tracking section PK as a digital image 
signal IDd. At the same time, the abnormal pixel correction section BD outputs a 
value of a pixel, immediately preceding an abnormal pixel (i.e., pixel which is not 
reported as abnormal), to the peak tracking section PK as a digital image signal 
IDd. 

The peak tracking section PK con-ects the value of the digital image signal 
IDd so that a peak value of the transmitted digital image signal IDd matches an 
appropriate maximum value in the data being output from section PK. If the 
background of the original document is not white (e.g., a newspaper clipping), 
section PK can make the background of the image data IDs confomi to a selected 
white value, such that the data IDs can be printed with an actual white 
background. To this end, the section PK can keep track of the peak value of the 
image data IDd provided at its input and normalize that peak value to actual white 
to make the background of the output data IDs white rather than the grayish tone 
of a typical newspaper clipping. Of course, the PK process can be applied to 
original documents other than newspaper clippings such as, without limitation, 
recycled paper in which the background is not white. The output data from section 
PK is supplied to a device of a next step as read image data IDs. 
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An image reading operation of an original document in the image reading 
apparatus includes four steps as illustrated in Fig. 3. That is, a standard shading 
data obtaining mode (step 101), an abnormal pixel detection mode (steps 102), an 
uncorrectable pixel column detection mode (step 103), and an original document 
reading mode (step 104). 

In the standard shading data obtaining mode, an image of the white plate 
WT (i.e., standard white image) is read before the original document DK is fed. 
The shading correction section SC stores the digital image signal IDb, which is 
output by the darkness level correction section BC, in the memory WM as 
standard shading data. 

As illustrated in Fig. 4, the standard shading data falls toward an all black 
level in continuous pixel regions LA and LB, which correspond to a size of fouling, 
at a position where fouling adheres at an image reading line. 

In the abnormal pixel detection mode, the abnormal pixel detection section 
BB examines the standard shading data stored in the memory WM by a commonly 
known method to detect abnormal pixels. The value of the standard shading data 
of the abnormal pixels is replaced with the all white value (FFh) or the all black 
value (OOh). 

For example, when standard shading data of an abnormal pixel is replaced 
with the all white value by the abnormal pixel detection section BB, the standard 
shading data illustrated in Fig. 4 is changed to the all white value (FFh) in the 
continuous pixel regions LA and LB as illustrated in Fig. 5. 

In the uncorrectable pixel column detection mode, the abnormal pixel 
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detection section BB examines standard shading data which is stored in the 
memory WIVI. A value obtained by multiplying a peak value of the standard 
shading standard data at that time by 0.9 is stored as the shading standard data 
of the continuous pixel region, when the continuous number of a pixel having a 
value of FFh exceeds an allowable correction number. 

For example, standard shading data is changed as shown in Fig. 6 (to 
FFh) when a continuous pixel number in the continuous pixel region LA is not 
larger than an allowable number. However, in this example a continuous pixel 
number in the continuous pixel region LB exceeds the allowable correction 
number. Herein, Vp is a peak value of the standard shading data, and Vm is a 
value obtained by multiplying Vp by 0.9, so the data for LB is changed to Vm = 0.9 
Vp. 

In the original document reading mode, the shading correction section SC 
outputs the digital image signal IDc as shown in Fig. 7 when an all white region 
was read with the fouling G1 in Fig. 1 , which is hidden by the original document 
DK, adheres to an optical system. In this case, a value of the digital image signal 
IDc is smaller than a peak value Vp of the shading correction data in the 
continuous pixel region LA because the all white value FFh was applied as the 
shading correction data. 

In the original document reading mode, the value of the digital image 
signal IDc for the region that corresponds in position to region LB in Fig. 6 is 
approximately 1.1 times larger than image reading data because the value 
obtained by multiplying the peak value VP of the shading correction data by 0.9 
was applied as the shading correction data. 
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The abnormal pixel detection section BB reports a pixel of the original 

document data, for which the value of the shading correction data was converted 
to the all white value FFh, to the shading correction section SC as an abnormal 
pixel. The shading correction section SC then reports the detection of the 
abnormal pixel to the abnormal pixel correction section BD. 

The detection of the original document data corresponding to abnormal 
pixels in the continuous pixel region LA is reported to the abnomnal pixel correction 
section BD via the shading correction section SC. There, a pixel value of the 
digital image signal IDd of original document data, which is output by the abnormal 
pixel correction section BD, is corrected by applying a value of the immediately 
preceding normal pixel of original document data in the continuous pixel region LA 
as shown in Fig. 8. 

In the original document reading mode, the shading correction section SC 
outputs the digital image signal IDc as shown in Fig. 9 when the all white region 
was read with the fouling G2 in Fig. 1, which is not hidden by the original 
document DK, adheres to the optical system. 

A detection of abnormal pixels in the continuous pixel region LA is 
reported to the abnormal pixel correction section BD via the shading correction 
section SC. A pixel value of the digital image signal IDd, which is output by the 
abnormal pixel correction section BD, is corrected by applying a value of the 
immediately preceding normal pixel of shading-corrected original document data in 
the continuous pixel region LA as shown in Fig. 10. 

In the continuous pixel region LB, whose length exceed the allowable 
correction number of pixels, a decline of the digital image signal IDd of shading- 
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corrected original document data is improved by approximately 10%. as seen In 

Fig 10, because standard shading data, which is obtained by multiplying Vp by 
0.9, is applied. 

Fig. 1 1 is a flowchart illustrating an example of process performed by the 
abnormal pixel correction section BD In the abnomrial pixel detection mode (i.e., 
step 102). 

Firstly, "1" is assigned to a variable "n" to memorize a position of a pixel to 
be processed at step 201. The shading con-ection data of the pixel "n", Vs (n), is 
read from the memory WM at step 202. 

Whether or not a value Vs (n) of the read shading correction data of the 
pixel "n" is normal is determined at step 203. When the answer is 'Yes" at step 
203, the value of the shading correction data Vs (n) Is set as a variable Vs' (n) at 
step 204. When the answer is "No" at step 203, the all white value (FFh) is set as 
the variable Vs' (n) at step 205. 

The value of the variable Vs' (n) is then stored in the memory WM at step 
206 as the shading correction data of the pixel "n". Step 207 tests whether or not 
a value of the counter "n" is equal to a total number of pixels N. When the answer 
is "No" at step 207, the value of the variable " n" is increased by "1" at step 208. 
The process then returns to the step 202 to perform the same process on the 
following pixel. When the answer Is "Yes" at step 207, the process is finished. 

Fig. 12 is a flowchart illustrating an example of process performed by the 
abnormal pixel correction section BD in the uncorrectable pixel column detection 
mode (i.e., step 103). 
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"1" is assigned to the variable "n" to memorize a position of a pixel to be 
processed, and "0" is assigned to the variable "Nd" to memorize a continuous 
number of abnormal pixels at step 301. The shading correction data Vs (n) of the 
pixel "n" is read from the memory WM at step 302. 
5 Step 303 checks whether or not a value VS (n) of the read shading 

correction data of the pixel "n" is equal to the all white value (FFh). When the 
answer is "Yes" at step 303, the pixel is judged to be abnormal. The value of the 

variable "Nd" is then increased by "1" at step 304, and step 305 checks whether or 

g not a value of the variable "Nd" now is larger than an allowable correction number 

9 "Nc". 

nj When the answer is "Yes" at step 305, a value obtained by multiplying the 

# peak value of the shading correction data Vp by 0.9 is set at the variable Vs'(n) at 

s 

f2 step 306. The shading con-ection data for all of the pixels, which constitute the 

S ™ 

j=y variable "Nd" including the pixel of the "n" number, is replaced with the value of the 
is variable Vs'(n) at step 307. 

Step 308 checks whether or not a value of the counter "n" is equal to the 
total number of pixels "N" at step 308. When the answer Is "No" at step 308, the 
value of the variable " n" is increased by "1" at step 309. The process then returns 
to the step 302 to perfomn the same process on the following pixel. When the 
20 answer is 'Yes" at step 308, the process is finished. 

When the answer is "No" at step 305, the process proceeds to step 308. 
When the answer is "No" at step 303, the value of the variable "Nd" is 
initialized with "0" at step 310. The process then proceeds to step 308. 
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As described above, according to an example of a preferred embodiment, 
a value for an abnormal pixel is set as a standard shading data for a pixel which 
requires a pixel conrection computation. The value for the abnomial pixel is set in a 
process of the abnonnal pixel correction section BD that is perfonned in a stage 
prior to the original document reading mode. A value corresponding to a peak 
value of standard shading data (i.e., a value obtained by multiplying the peak value 
by 0.9 according to an example of a preferred embodiment) is set as the standard 
shading data for a pixel in a region where the pixel cannot be corrected, namely, in 
a region where the number of successive abnormal pixels exceeds an allowable 
correction number. 

Therefore, costs of an image reading apparatus can be reduced because 
special memory device for memorizing a position of an abnormal pixel is not 
required. 

In the above-described example, the all white value (FFh) Is applied as a 

value Which shows an abnormal pixel, however, the all black value (OOh) may be 

applied In place of the all white value (Ffh). 

Further, the number of bits digital image signal is 8-bit in the above- 
described example, however, a digital image signal of more than 8-bit may be 
applied. 

According to the above-described example, a line image sensor is used to 
convert an image of an original document into an electric image signal, however, a 
photoelectric conversion element other than the line image sensor may be 
employed to the present invention. 

Numerous additional modifications and variations are possible In light of 
the above teachings. It is therefore to be understood that within the scope of the 
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appended claims, the present invention may be practiced othenA^ise than as 
specifically described herein. 

This patent application is based on and claims priority of Japanese Patent 
Application No. 2000-347726, filed on November 15, 2000, the entire contents of 
which are hereby incorporated by reference. 



Page 17 of 27 



